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2 1 AUG 


MEMORANDUM FOR THE RECORD 
Secretary 

SUBJECT: Minutes of the 22 July 1976 OTR Staff Meeting 


1. The 22 July 1976 OTR Staff Mee ting convene d at 

1400 hours and adjourned at 1555 hours. introduced 

the film KITA which was shown to the group. 

2. Chief, FTD , briefly reviewed the background . of the 
paper on Technology Applications in the Office of Training. 

The DDTR noted t hat t wo actions had already been taken: the 
data link to the and closed circuit, television in 

classrooms. The members discussed other items in the paper 

at some length. Significant actions were assigned as follows: 

a. Following a discussion of videotaping 
presentations in various courses, the Unit Chiefs were 
requested to prepare a list of those activities which 
should be taped for submission to Chief, TSS. 

b. During the discussion of Section 2.1 of the 
paper, the DDTR pointed out that the list represented 
only a series of ideas, not recommendations. The 
Secretary was charged with obtaining recommendations 
from the Unit Chiefs. 

c. It was pointed out that Time-Life has put out a 
series of tape cassettes on the use of videotape for 
testing purposes. The DTR requested that one of these 
cassettes be shown at the next Staff Meeting. 

d. The DTR asked the Chief, TSS, to check on the 
television used by NSA as an information mechanism for 
employees. 


e. During the discussion of the use of computers 
in simulation training, it was suggested that Messrs. 

dress the Curriculum 

Comm^^^or^tn^suD^^^^^ 


ADKIKI SHkATIVn — 
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£. The group briefly discussed the use of 
computers to assess instructor loads. The DTR asked 
Chief, n to resurrect a system which he had developed 
m LLC and explain it to the Units Chiefs. 

T * The discussed 0TR organization. The OTR 

If °? the ■■barter will be issued in the near 
“ e als^^ined a new title and revised responsi- 

from^fr He a ? nounced one personnel shift 

rrom LLC to LTD and a reorganization within LLC. Finally 

matfp?° rt ^i t t at . a g r ° u P o£ OTR Instructions on personnel’ 
matters will be issued to help people know how things work 
and their responsibilities. 

n ?* m , The S rou P had no comments on the OTR Personnel 
Report. They then considered the pending actions list. 

completed ntrieS W6re deleted since the actions had been 

5. The DTR reported on the DDA morning meeting. The 
members then reported significant events of the day. 
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OTR STAFF MEETING 

Thursday, 22 July 1976, 1400 hours 
AGENDA 


Film: KITA 


Technology Applications in 
the Office of Training 
* (See copy attached.) 



OTR Organization 


Mr. Fitzwater 


OTR Personnel Report 


Mr. Fitzwater 


OTR Pending Actions 


Mr. Fitzwater 


The Day’s Events 


uss oijly 
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TECHNOLOGY APPLICATIONS 1)1 THIS OFFICE OP TRAINING 


Introduction 



nature of OTil's responsibilities and 
and implementation of television and 
appear to bo most promising, both in 
tions and tho number of functions affoctcd. 


nctivi 
computer 
the kinds 


a* Ad.aj)i 
techniques 
of applica- 


AppXicatious of TV technology which appear feasible are 
described first* followed by computer applications and a 
short section on other applications. The proposed applica- 
tions aro stated in a general way and may bo applicable to a 
number of specific OTA activities, but to provide a cle arer 
understanding of t ho potential computer applications at 
a detailed listing is included in tho computer applicatiW 
section* A chart at tho end of this paper surmaricos the 
estimated range of costs and time required for implementation. 

None of the tccJmoIogy applications is very grand: 
costs range from trivial to modest and tho tine required to 
apply tho technologies is generally short- -a year at most* 

It is the consensus of the Task Force that implementation. 

If desired, will depend critically on management * s ability 
to inculcate a spectrum of attitudinaX and' behavorial 
changes. , • 

2. . Television Applications ‘ ; .. 

2*1. There are group of applications which nay be 
used in training which coal with the natter of informing or 
motivating the student, or developing his skills . With 
certain adjustments they may apply to cither tho cla: 
or self-study activities. 


STATINTL 


:roora 


2.1.1. Expositor)". Tho presentation of basic 
information can bo accomplished via CCTV rather than in 
tho r.ioro traditional methods such as tho live lecture, 
tho motion picture, reading, and in some instances, 
field trips. Tapes of prominent guest speakers or 
‘'one-shot" presentations can bo taped for later use in 
classes or for distribution to wider uudiencos. 
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ivoseiitation of drcaatixod versions ot ‘ how-to 01 


nrcncntat.xoii vx n . . 

••how-not-to" do something to ns to servo as a xoi 

discussion. CCTV format can replace souo written caso 
histories and can provido^ tiio additional r and ouen 


t]i at. 


the 


written word frequently- 


ill '[TO d iciits Vd*w y, x 

to 'furnish. CCTV can take tho place oj n 

1 car.o history vnonovor cio presenter 


vital 
fails 

orally pronentot 
cannot appear in person. ' 

2*1,3* Performance Critique. Immediate feed- 
back of student performance of an assigned task permits 
v^rc accurate assessment of both flaws and gens xn the 
«r»rfftrmmco Permit tin a the student to retain tne tapw 

o£ his performance for specified periods of tins allows 
the student to study his performance in detail over and 
over again. This same tecnniqu© can do wo 

irnrovo the performance of instructors. A typical 
wre* on t at i on can .be taped to allow the instructor to 
subsequently perform a 5 olf- critique of his presenta- 
tion techniques. ■ 


2.5*4. Testing. CCTV format con bo used to 
supplant or supplement traditional paper 
tests and written cases to do analyze*. It can be u-.ee 
to judge porfornanco on man-maemne, man- object,, 
man-wan tasks in much tho sane way as xt is vson 


to 


inan^LUui x.u.\>iw xil „ , r . ^ _ - _ 

provide performance critique. Tho major diyxeroncv. rs 
that, one use is for practice and the other is for 
“score." This application can oo c o n o i n c d w it. h_c o ) a p u t e i 
technology to provide automatic scoring and instant, 
feedback 0 and correlation to tho student v/hen useu as a 
substitute for the paper and pencil tost.s. 

2.x. S. Review. Tho highlights, or sunaary o£ a 
lesson, or of an entire course, can bo prepared in uCTV 
format and used in the following ways — by tho f>tuaen.. 
in preparing for a test; by an officer who wxsno^ to 
refresh his memory or bring himself up to cdto o:i tno 
subjects, skill, procedure, etc., tnat ne stuuioc. xn 


tho past * that ho KasnoT^od or thought about recently; 
by instructors , their supervisors, and 01 il management 
in general as reference material, a supplement, to 
lesson plans, etc. 

2.2. Managerial. This group of applications addressos 
:ho matter of downward communication from tho xUR level on 
subjects of managerial significance from Oi'R personnel. . 
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plans, policies, procedures , etc. , r 
per s Oiijicl , login ties , security, *La), 


relating to finance, 
curriculum , organiza- 


tional change » into r-o.t lice and intor-iJi roctorato activities, 
otc. It would bo possible to tape tho daily Staff Meetings^ 
sensitive natters for an Executive Session) and 


the following day, thus providing^ 
that installation v;ith a closer Hide. 


(Icavrl ng 
sond the tc.no 
selected of£i 

v;it!i OTR Hone: quarters and with a better "feol" for tho 
various concerns cry; res sod at such meetings (and with a 
quick "fin" on tho 1/il/A’s morning meetings). 


2.3. Admin is tret ive/Ewpl oy ce Relations, This group of 

the word" out 
ich 


applications addresses the problem ox "getting the wore" 
on upcoming events ex importance (or the results of such 
events) to all employees or to selected interest groups. 
Again, without going into detail, it would be possible to 
convoy information concerning the annual Consolidated 
Charities drive , Fire Prevention and Safety Weeks, Blood- 
mobile visits, iiEA events, parking restrictions and oppor- 
tunities , flu shots, awards and commendations , and so on--, 
almost ad infinitum. 


3. 


Computer Aunlications 


mputor applications may be used in a variety of ways, 
hich may bo used to improve tho effectiveness or 


Co 

Those which may 

efficiency of the instruction arc presented in 3. 1-3. 3. The 
application of computer technology to enhance the support to 
instructional programs is described in 5.4-3. 7. ‘iue items 
relating to instruction could be used to improve OTR’s 
administrative function end, in addition, other special' 
technology applications may bo feasibly 
ill 3.0-3.15. * Special applications for 
3.16. 



pose are 'described 
re detailed in STATINTL 


3.1. More Extensive Use of Computer-Aided Instruction. 
In tho Information Science Center, wo have a preliminary 
version of a set of instructions on the use of data bases 
which are available through the DIAOLS computer system. 

This computon^uyi£i^^i^£il£tion, which was developed by a 
DXA intern be extended to provide 
orient at ion level of operating capability, 

for OTR personnel nnd others who may need to operate com- ' 
putor systems in the future. 


1 . 
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3.2. SinulatJ.cn Training. Mo have dovcl^ned several 

■ J* J . 1,111 . 1 '^or :: 0)10 

ol w}n.cn r ao not- -to proYru© experxenco wlu.cn cannot bo 

readily gained through loot lives or other conventional methods 

For cxnnjilc , a manual simulation exorcise, "Tho Inventory 

Cano," is used to demonstrate to s tudontr. tho difficulty of 

solving inventory and similar problems through intuition or 

conventional thinking. In general, although simulation 

involves some s inplification, significant savings can bo 

achieved in terms of time and equipment. 

3.3. Test find Course Evaluation. The Information 
Science Center has recently acquired cqu.ipj.icnt which is 
capable of mark-sensing. This kind of equipment is used 
frequently to score aptitude and similar tests. Vo have 
used it hot]), for scoring tests and obtaining statistical 

1 . . _ ... -1 . , ■ y, ... ... 


Using t 


is - equip - 


data on student evaluations of courses, «q 

wont, test data and evaluation data can bo obtained so 
quickly that critiques with the class can be conducted 
shortly after the tests or evaluations arc completed, 
assists in obtaining additional verbal comment on the uuuiac 
or tests which would otherwise riot bo possible. Further, we 
plan to use the same equipment to develop statistical data 
of student responses in follow-up questionnaires six months 
to a year after they have completed information science 
courses. 


This 
courses 


3.4, Improvements in Instructor 
been dovcloned for use at 1)TS to 


has 

manual c 
instructo 
methodology 


Assignments. A pr ograja 
eliminate much cf the 


t required in identifying possible student- 
assignments in operations training. This general 
mi giit be useful elsewhere where instructor or 


student assignments are difficult to 


arrange. 


3.S. Assesses Instructor Loads. If instructor activitie 
or© entored into a data base, it becomes relatively easy to 
develop statistical data which indicates the amount of 
instructor time involved in course preparation, delivering 
lectures and other activities. It also permits profiles of 
activities to be extracted from the data for individual 
instructors. 


3.G. Developing "Do" Lists, There arc a variety of 
acn i n ir.tr a t i ve tasks wnich generally have to be performed 
prior to, during, and after courses. The continual change 


. - — - ..atmual 

in personnel results in important activities being over- - 
looked or not ecu' for nod at the appropriate time, 'it is a 
relatively simple matter to prepare basic lists of tilings 
that must be dona for any courso which arc keyed to the tine 


4 
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W hen the course starts. A simple ' computer program cXn then 

bo used which will indicate what mist bo uouo tor eaca 
course raid the person responsible ior it. loose can bo used 
ns checklists to none sure 'that essential tasks arc per to; .hoc 

*3»7« Pxocditing Security Approval for ( . o u i. a e s . 
courses require special clearances. If minim stra dvo 
a euro vat could bo* obtained, the OTR Security officer could 
have access to a special file which lists all persons mud- 
j n rr special clearances, '/air. would eliminate soi .10 aununs- 
irativo or o cos sing and it would be especially useful wnuu 
lasVninutc changes have to be made with respect to the 
students attending a course. • 

3.8. Into r 11 a 1 / Bxt o r n a 1 Surveys. The sane equipment 

which is used for scoring evaluations and tests in. c^a^scs 
for follow-up could also bo used to quickly and easily 
develop statistical in forn.it ion. regarding attitudes anc 
other items of nsnagemcAt interest, within 0 x k and among tue 
various organizations v/iio are concerned with the services 
which OTR provides. . ' 

3.9, OTR Simulation. Various OTR functions could be 
simulated so that management decisions could be accessed, 
more fully and easily. In developing these khus 01 simula- 
tions, "indescribable systems" are sometimes . encountered. 

Tills is frequently an indication that some kind ox dysfunc- 
tional activity has crept into a management or operational 
structure. ' • • . > • 

3.10. Registration Data. The computer data base can ^ bo 

used to provide current information cn the status Oj. regis- 
trations for courses and it can also bo used as a source xor 
statistical studies. •• 

3.11. Budget Information. Pro grans can bo developed _ ■ 

which will provide individual organisational entities with 
an up-to-date status of their budget ns well as proviao an 
overall view of the budget status for tho Office and i*-s 
operational elements. 

3.12. Personnel . A program to keep track of OTP. per- 
sonnel status is currently in development. 

3.13. OTR equipment Inventory. Programs can readily bo 
developed which will not only indicate the physical location 
of equipment , hut can also he used as n reminder mien modi- 
fication or maintenance must be performed. 
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3.1'k Library* Programs are widely used in various 
’organizations to list daily tho status of any publications 
which arc on loan fro: a tho library. 


3v.lS, Uditing, Ktc. „ for TAP. Tditing rout in on aro 
avail ah lo in both tho CIA and tho jJIAOLS systems which could 
bo used to extend end enhance TAP's capabilities. 


statiKitl 

STATINTL 


STATINTL 

STATIML 


3.XG. | 

assignment 


instructor 
d level of 
makes 
bio 


dos 


.LV 


^^Applications. In addition to the 
prep. r an mentioned above, tho increns 
activity a 1 i n v o 1 v i. • \ g both old ciiid yiov xvuic 
computer use at that installation increasingly 
both for support and training activities. On the support 
side, a computer program could bo used to advantage for 
inventory control and to support the Station objective for 
preventive maintenance p rogra m . The establishment of a 
computer terminal at tkeHH would enable the Station to 


a 


!.eecn 

for 


to 


host more sophisticated conferences which require 
Headquarters programs. offers a good facility 

dovelopmc-nt of operational computer applications in such 
areas as record storage in tho future field station and tho 
analysis of personality data for recruitment operations . As 
a practical matter there is no officer currently at tho 
properly trained to develop computer applications at th( 




>o 


assign- 


Station for training and support activities and 
went of such a person there is necessary to exploit tho 
considerable potential the Station offers for computer 
applications such as those identified in the following list. 



STATINTL 


Training functions . 

.operational 

' technology and uso of computers 
computer security/panetration 
modeling 

-recruitment ■> ' 

-targeting 

-field station operations 
-local political situations 
computer conferencing 


ng 

Support functions 
Personnel data base 
Course registration data base 
Preventive maintenance system 
Cost model and cost projections 
Logistics - inventory control 





1 I 

I! 

i 

:e 
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^^^BvJ.sitor mul user support 
Available criTKibi 7.x ties 

OJCS-;a;v, ported 6IM-II CA)o.:5 
lixtensivo progrn: cuing Isr.guago 
, Statistical analysis packages 

compiler for modeling 

. . I ST U - r» uppo r ted Information Science data base 

SAIdi x ilea and software 
1 1> Til - s u p p o r t e d data management softv/aro 
Potential users ' 

Project SA1 : H development and design, teams 
DDSQT system designers 
■ MaUl-ccr oer and Senior Seminars 
Other component training usings OJCS system 
■ -ox-0ff i.co of Plnanco information Science Course 
now at 

3.17 Language Learning Center. The Language Learning 
Center currently has an objective to study tho feasibility 
of .using a computer program for student registration and 
library charge cuts. An additional computer application at 
the Center nay be in the handling of statistical data in 


support of Language bcvelcpnent Ccmmittoo activities. 

4* Other Applications 

4.1. Audio Cassettes. As a method of checking perform- 
ance* this application is of consider able value irTlcnguago 
training as a means of expanding 'the teaching time available 
to a given course; subject natter can be recorded on audio 
assottos and assigned as homework. Test questions can bo 

rv r\ r- ^ c c / i t a o *+* ^ A n « .t . _ a . J m „ . . . _ i 


tho 


4.2. Correspondence-Typo Courses. Using tho word 
technology in a broader sense than that reflected by 
preceding descriptions of machine- oriented or device- ori- 
ented applications, there nay be utility in the traditional 
Correspondence School" approach to training. Only those 
courses which claim to touch or depend upon' student inter- 
action appear to bo not susceptible to this approach. Any 
course which is devoted exclusively (or could" be devoted 
exclusively) to imparting .information to students (as 
distinct from developing skills or enhancing motivation) can 
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be converted to n correspondence format . Wessons may bo 
programmed. (a:; in "Pro<;rc:.i Assisted Instruction”) or not, 
and there is none evidence taut certain types o£ “laboratory “ 


expo vimontut ton can be 


ino.li 


od m the pacKr.fto 


kits 


which can be tent to the student or "nanus- 


moans ox 
i“ drill. 
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f Subject ?; Pnrc'V’.rnph 


Cost Fr.tiru’to 

Sd:o ax' .1 c/C o: sacs i C 

IV - JLvxisitory 

2*1.1 

0 - $ IS, ODD 1 

'0 *» 6 jacn£J.is 

" - Illustrative 

2.1,2 

0- Sis^ooo 1 

1-12 months per 
hour of finished 
product 

; 

1, Sane costs. If invcstcortt is nn 
incurred for 2.1.2, and vico vex 

do in 2*1.1, no additional 

SZt 

costs will be 

;; TV - Pcrforxumco Critique 

2.1.3 

. 0 - $50,000 

IianicdiatB 

•* - Testing 


$1,000 - $10,000 

6 -12 months 

" <- Review 


0 - $2, SCO 

1-6 months per bom 
of finished prcuuci 

Vsaagfcrial Use of TV 

2*2 

$1,000 -,$25,000 2 ■ 

3-9 months depcndii: 
• upon scope 

Atkin. /Eqpl . Rol-'XV 

2.3 

$1,000 - $2S,C00 2 


i 2, Sciao costs. Interdict 

igoable as 

in 2.1.1 and 2.1.2 above. 

■ - 

Cavputcr-Aided Inst* 

3*1 


JJoponds on available 
personnel timo 

Simulation 

3.2 


do 

i Test fj Course Lvuliu.it ion 

3.3 

<* 

tr. 

1 Instructor Assignment 

3.4 

m 

•i 

Assess Iiis true tor Loads 

3.5 

•» • 

ir 

j W Lists 

3.6 

mm 

il 

bxpeo i t cd Clean'; ices 

j 

• 3.7 

m 

u 

1 

j latcrnol/Uxtomal ikuToys 

3.8 

m 

* 

it 

OTR Simulation 

3.9 

' mm 

it 
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RuMect f> Parirroph 


■ Coat r.;tJnn to 

Sd ic:1 u 1 e/ Cent . »e? i 1 a 

Rt: j is t ra t i w \ Rat a 

5.10 

m* 

do 

JAulRct Information 

3.11 

m 


reiv-onne! Data 

3. 12 

«* 

’ l( 

Kquijtnont Inventory 

3.13 

’ 

tt . 

Library Records 

3.14 

* 

1» 

Editing for TAP 

3.15 

«k* 

11 

INTL 

Application 

3,16 

a* 

Cceiiiunication f 5 othe: 

•t 

. . 


facility costs 



• 

’ .. . V 

described in other 
jiscrjoronda 

Audio Cassettes . 

4.1 

. $1,000 

. 6 months and trp 

Correspondence Courses 

4.2 

• $1,000 up 

. 6 months and up 


9 
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